Python Job: Data Engineer

Job added on

Company

vsoft consulting
Canada

Location

Remote Position
(From Everywhere/No Office Location)

Job type

Full-Time

Python Job Details

Job Title: Data Engineer - Azure

Location: 100% Remote Role

Job Type: *Fulltime*

Interview Process: Teams Video Interview

Skills or key competencies sought:

The expertise: you have five or more years of experience working with big data, especially clickstream or event data. You know how to create clean and robust data models that are normalized and specialized for data analysis and data science applications. You know how to extract, standardize, and transform raw data from a myriad of different data sources. You have experience enforcing and applying quality control for incoming and outgoing data.

Technical skills:

  • Experience with the Azure and Google cloud environments, especially Azure Databricks, Delta Lake, BigQuery, Azure Data Lake Storage, Azure DevOps
  • Experience with big data / distributed computing platforms and practices, especially Spark
  • Experience with workflow automation & management tools, especially Apache Airflow
  • Creating clean code in SQL and Python
  • Experience with very large datasets (millions or billions of rows)
  • Creating data pipelines using APIs as well as flat files
  • Experience with structured, unstructured, and semi-structured data
  • Experience with batch-processed data as well as streaming data

Job Types: Full-time, Permanent

Salary: $73,972.03-$115,000.00 per year

Benefits:

  • Company pension
  • Dental care
  • Disability insurance
  • Employee assistance program
  • Extended health care
  • Flexible schedule
  • Life insurance
  • Paid time off
  • RRSP match
  • Vision care
  • VRSP
  • Work from home

Schedule:

  • 8 hour shift
  • Day shift
  • Monday to Friday

Supplemental pay types:

  • Bonus pay

Experience:

  • Data Engineer: 8 years (required)
  • Azure: 5 years (required)

Work Location: Remote

Application deadline: 2023-01-07
Expected start date: 2023-01-23